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Abstract 

Given previous findings on test enhanced learning, the present study examined the implementation of this practice in 
terms of quizzing, during the progress of a course. After completing the university course, 88 Swedish teacher 
students were asked to answer an adapted Retrieval Practice and Test Anxiety Survey. The results showed that 
students perceived quizzing to improve learning, and reduce test anxiety. Nonetheless, based on students’ 
misconceptions regarding why quizzing actually enhances learning, it is suggested that implications of test enhanced 
learning was not frilly conveyed. It is for educational purpose imperative to not forget this application. 

Keywords: The testing effect, Test anxiety, Teacher education. Quizzing 
1. Introduction 

1.1 Durable Learning 

To study is one of the most used strategy to learn, but studying per se is no guarantee for actual learning to be 
successfully achieved. For the intended learning to occur, the to-be-learned-information needs to be mentally 
processed; i.e. fundamentally, be preserved, or formed to a memory (Zovkic, Guzman-Karlsson, & Sweatt, 2013). 
Simply put, as memories are formed, learning takes place. The effectiveness of learning, ultimately memory 
processing, is closely linked to the type of study practice the learner is subject to. 

Several studies have substantiated that study activities resulting in durable learning, require students to be engaged in 
effortful activities (Freeman et ah, 2014; Pennebaker, Gosling, & Ferrel, 2013). One method, that has shown to be 
superior compared to several common learning methods and across different study materials, is test enhanced 
learning or repeated testing. Test enhanced learning requires the student to actively retrieve knowledge from memory 
when responding, and each time an item is retrieved this strengthens the memory traces (Hattikudur & Postle, 2011). 
The effect following test enhanced learning is commonly referred to as the testing effect (Dunlosky, Rawson, Marsh, 
Nathan, & Willingham, 2013; Karpicke, 2012). The testing effect refers to empirically demonstrable enhancement of 
the long-term retention of information by repeated tests (Roediger & Kaipicke, 2006). 

Nonetheless, relatively few students have knowledge of or utilise test enhanced learning as a study tool (see e.g., 
Benassi et ah, 2014; Gilmore & Cragg, 2014; Schutte et ah, 2015). This may come down to lack of knowledge about 
test enhanced learning as a learning event in itself. In order for students to develop effective study strategies they 
initially need to be informed, and schooled (see Einstein, Mullet, & Harrison, 2012). In the present study a sample of 
Swedish teacher students were engaged in test enhanced learning in the form of repeated quizzing. 

A key element of any education system is testing, in large part because there can be no knowledge of the outcome of 
the education without tests of some kind. But in the perspective of so far summing efforts, and forming future 
endeavours, students who take tests will most likely to some degree and at some point experience stress and worry 
linked to testing. Thus, for some individuals testing may be associated with high stress and worries. These worries 
may result in, among others things, impaired testing performance and learning, a phenomenon often referred to as 
test anxiety (Liew, Lench, Kao, Yeh, & Kwok, 2014; Nelson, Lindstrom, & Foels, 2014). On the other, implementing 
testing during the progress of a course, as a supplementary aid in learning (i.e., indirect effect of the testing effect) 
might reduce these negative emotions (Messineo, Gentile, & Allegra, 2015). The present study also examines this 
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phenomenon in the perspective of teacher students’ experience of test enhanced learning. 

1.2 Testing: Pros and Cons 

Correctly applied, testing is a powerful learning tool; on the downside it may lead to high levels of stress; the crux of 
testing is to minimise performance anxiety, while at the same time enhancing its beneficial effects on learning. A 
strong candidate for such good practice is repeated quizzing, a method that may enhance learning while migitating 
examination stress (Hinze & Rapp, 2014; Messineo et ah, 2015). 

1.3 The Testing Effect 

Testing is not merely an encoding trial or neutral in terms of learning, as it promotes a form of processing of target 
material that improves retention and subsequent test performance. Hence, testing is a robust technique for both 
assisting students in learning, and improving their memory of the material (McDaniel, Anderson, Derbish, & 
Morrisette, 2007; Roediger & Karpicke, 2006). Test enhanced learning may therefore be a valuable pedagogical tool 
and enhance learning via both mediated and unmediated effects (cf. Jensen, McDaniel, Woodard, & Ktimmer, 2014). 

The mediated (or indirect) effects are related to for example students’ motivation and attitudes towards various 
aspects of school, the encouragement to study more continuously and prepare for class, the shaping of their 
learning from feedback, information about what they have and have not learned, guidance for future study, and 
acquisition of ‘test-wiseness’ (McDaniel et ah, 2007). In sharp contrast to widely expressed concern that excessive - 
particularly high stake - testing caused stress and worry among students, test-enhanced learning appears to reduce 
this syndrome (Messineo et ah, 2015; Szpunar, Khan, & Schacter, 2013), and students who are accustomed to regular 
tests seem to develop resistance to test anxiety (see Meyer & Logan, 2013; Nyroos, Korhonen, Linnanmaki, & 
Svens-Liavag, 2012). 

The direct (unmediated) effects of testing are the enhancement of higher level thinking and memory (i.e., the testing 
effect). A growing body of empirical evidence shows that repeated testing is highly effective for improving the 
accuracy of long-term memory - frequent testing is a powerful mnemonic aid for future retention (Roediger & Butler, 
2011; Rowland, 2014). Test enhanced learning has recently been acknowledged as a learning method with the highest 
utility compared to other pedagogical methods. Specifically that the method produces sustainable learning (Dunlosky 
et al., 2013) has great potential for educational purposes. As a person takes a test and retrieves some piece of 
information the memory traces are strengthened. This promotes long-term recall via a process different from 
studying the same material repeatedly, and thus may be beneficial for both high- and low-achievers 
(Wiklund-Hornqvist, 2014; Wiklund-Hornqvist, Jonsson, & Nyberg, 2014). 

Furthermore, taking a test on a specific material can have a greater positive effect on future retention of the material 
compared to studying it for equivalent amount of time (e.g., Benassi et al., 2014; Hattikudur & Postle, 2011; 
Pennebaker et al., 2013), even if the performance is far from perfect and no feedback is given (Roediger & Karpicke, 
2006). Repeated study may yield better results in immediate tests, while repeated testing will foster superior 
long-term retention, as manifested in results of tests after several days or years (McDermott, Agarwal, D’Antonio, 
Roediger, & McDaniel, 2014). 

Testing has also proved to be an effective and highly useful strategy to avoid mere rote learning and promote deep 
and meaningful understanding of the studied material (Dunlosky et al., 2013). This is at least partly because it 
counteracts tendencies of students to stop studying before the material is adequately learned (Miesner & Maki, 2007), 
or once they have just understood it (Metcalfe, Kornell, & Son, 2007). Testing may also counter the tendency of 
some students, notably those with memory problems, to use simpler but less effective tools such as rehearsal of 
information (Jonsson, Wiklund-Hornqvist, Nyroos, & Borjesson, 2014; Pennebaker et al., 2013). 

There may be resistance to testing and/or low awareness of its benefits because repeated studying may be regarded as 
less demanding, more advantageous in the short term and thus more appealing than testing (Roediger & Karpicke, 
2006). Accordingly, Kornell and Bjork (2007) found that only 18 % of 472 college students regarded testing as 
learning events. In keeping with this, a study by Kaipicke, Butler and Roediger (2009) showed that among 177 
surveyed undergraduate students, only 1 % listed self-testing as the number one learning strategy, whereas 55 % of 
the students ranked restudy the material as the number one learning strategy. Given these results it seems that 
students lack the knowledge of how to best regulate and monitor their own learning in order to become a 
sophisticated learner (Bjork, Dunlosky, & Kornell, 2013). 

The testing effect has proved to be robust across diverse types of materials (e.g., verbal, prose passages, symbols, and 
simple pictures), different types of tests (e.g., prose materials, free-recall, multiple-choice or short-answer, high- or 
low stakes tests), and disciplines and contexts (e.g., laboratory settings and classroom) as well (see Stenlund, 
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Sundstrom, & Jonsson, 2014; Wiklund-Hornqvist et al., 2014). Although the testing effect has been repeatedly shown 
to have significant learning effects, relatively little attention has been paid both to apply it in practice and researching 
ways to optimise its application in naturalistic settings (Benassi et al., 2014; Karpicke & Blunt, 2011). In Sweden, 
overall, little attention has been paid to the testing effect (see Stenlund et al., 2014; Wiklund-Hornqvist et al., 2014). 

1.4 Test Anxiety’ 

Individuals who suffer from test anxiety feature excessive fear and problems with functioning - before, during and 
after taking an exam - as a result. Symptoms are distributed along a continuum and range from moderate to severe, 
and commonly include physiological, behavioural and cognitive responses related to a test situation (Putwain, 2008). 
In the short term test anxiety is generally associated with impairment of academic performance and educational 
achievement (Maloney, Sarrizahn, & Beilock, 2014), while in the long term it may diminish access to educational 
and occupational opportunities (Kumar & Karimi, 2010), and contribute to ill-health (Putwain, 2008). 

Test anxiety is believed to interfere with memory performance by disrupting encoding and the organisation of the 
rehearsed material, and subsequent retrieval of the rehearsed material in test situations (DeCaro, Thomas, Albert, & 
Beilock, 2011; Maloney et al., 2014). Elevated levels of test anxiety are also linked to procrastination and loss of 
motivation to engage in academic work (Mavilidi, Hoogerheide, & Paas, 2014). Although levels of test anxiety 
depend on the social and educational functions of both the schools and tests involved (Song, Bong, Lee, & Kim, 
2015; Varela & Hensley-Maloney, 2009), for example whether the tests are low- or high-stakes (Segool, Carlson, 
Goforth, von der Embse, & Barterian, 2013), it typically weakenes educational performance, and burdens individuals 
regardless of the cultural setting when levels are excessive (Liew et al., 2014; Nelson et al., 2014). Nonetheless, in 
Sweden test anxiety has drawn little attention from the educational field (see Nyroos et al., 2015). 

In summary, repeatedly administrating course based quizzing is a resource-effective instructional method that could 
potentially improve students’ achievements in exams and reduce their exam stress substantially. Testing effects and 
test anxiety are potentially important educational factors to exploit and address, respectively, in both research and 
practice. The present study addresses the two benefits of the test enhanced learning in the settings of a regular 
Swedish university course. 

1.5 Swedish Education 

Two important prerequisites inform Swedish education and span through all levels of education: governance by 
objectives and results, and equal educational opportunities to all citizens. The adoption of a far-reaching 
decentralisation serves as a means to accomplish both prerequisites. The introduction, of e.g. school autonomy, 
increased individualisation, school vouchers, and entrepreneurships, encompass a curricula content and 
corresponding grading criteria exploiting metacognitive and self-regulating abilities (see Partanen, 2016), and has 
meant a shift in responsibility from the school to the student; as well as a shift from a fact-intermediary school to a 
strategy- and tool-intermediary school. 

Over the years, testing has gotten a rather tarnished reputation in the Swedish school system, leading to schooling 
that involves few examinations by international standards (see Nyroos et al., 2015), and requires students to spend 
minimal hours outside class doing homework or other study set by teachers (OECD, 2014). These are also common 
features of Swedish teacher education, in which seminars and memos are prominent forms of assessment 
(Hogskoleverket, 2006; SOU 2008:109), but there are generally few unit exams (Lundgren, 2001), and expected 
learning outcomes tap the “master-apprentice model of learning”, which focuses on apprenticeship, and proven 
experience (Mannikko-Barbutiu, Rorrison, & Zeng, 2011, p. 52). 

Moreover, Lundgren (2001) saw that teacher students spent substantially less time studying than many of their peers 
tackling other disciplines (i.e., medics, civil engineers, and psychologists). Lundgren concluded that the variation in 
time was a manifestation of different traditions of demands and studies, as well as students’ disposition towards their 
studies. This line of reasoning has been supported by SCB (2007), and recently by Bertilsson (2014), who concluded 
that in Sweden today a high proportion of teacher students are academic low-achievers who lack effective study 
strategies, and spend little time on studying. Equally, in an OECD (2015a) report, the declining status of teacher 
education, as compared to other educational programmes, was argued to have led to low admission requirements. 

Sweden’s teacher education is to a high degree decentralised, meaning that qualification description and goals for the 
teacher qualification is laid down by the Government, and all teaching training colleges autonomously decide on 
course content and forms to fulfil these requirements. However, recently OECD (2015a) designated this 
decentralised system to be responsible for poor Swedish teachers’ instructions methods, as well as for Swedish 
15-year-olds dramatic academic performance decline on international rankings. Instead of course contents focusing 
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effective teaching and learning methods, teacher education were blamed to constitutes a platform advocating 
progressive education (OECD, 2015a). The consequences are apparent across ages; for example in a study by Falch 
and Running (2012) on the effects of homework, Sweden emerged as an outlier with a significant negative effect of 
teacher assigned homework on student achievement in mathematics and science when compared to 16 other 
countries (TIMMS). In the PISA 2009 report, Swedish students scored below the OECD average on several measures 
on effective study strategies: Swedish students were among the least knowledgeable about effective strategies in 
terms of: to understand and summarise information, to understand and remember information, to understand and 
memorise information OECD (2010). In addition, 84% of 15-year-old students in Sweden think they perform poor on 
an exam irrespectively of having studied or not (OECD, 2012). In a study by the Swedish National Union of Students 
(2014), Swedish university students ranked instruction on learning activities - that were planned by the teacher and 
initiated by the student - as the most important factor to promote quality education. 

Teachers are responsible for implementing, upholding and realizing centrally stipulated objectives and guidelines 
(Beach, Bagley, Eriksson, & Player-Koro, 2014; Crasborn, Hennissen, Brouwer, Korthagen, & Bergen, 2008) but the 
outcome inevitably depends on the organisation of studies and set education content, as appointed assignment and 
implementation approach (see Stone-Johnson, 2011; Swoboda, 2014). The educational quality is in some respect also 
depend on what learning activities teachers promote and provide to students (Freeman et al., 2014; Pennebaker, 
Gosling, & Ferrel, 2013). From the vantage point of teachers, the instruction methods the teacher has been subjected 
to as a student, is argued to be reflected in the instructions methods later adopting as a teacher (see Morehead, 
Rhodes, & DeLozier, 2015). In a sense, the foundation of teachers’ knowledge on instruction and learning, is teacher 
education (cf. Nilsson Lindstrom & Beach, 2015; Poulou, 2007). 

From this perspective, to partake in activities based on advances in so-called non-traditional field, such as cognition, 
that could improve learning and development for teachers, and teachers’ mentors, is imperative (Freeman et al., 
2014). Experimental research on human learning and (especially) memory could offer concrete guidance regarding 
strategies to optimise teaching and enhance learning (see Engle, 2010; Freeman et al., 2014). Therefore, the present 
study examines the experience of a sample of Swedish teacher students subjected to a university course adopting 
cognitive based learning, i.e. test enhanced learning. 

1.6 Aim 

The aim of the present study is to investigate which learning strategies students commonly use and examine how 
students perceive the implementation of test enhanced learning during the progress of a course. More specifically, we 
address the following research questions: 

ql: What are teacher students’ main study habits? 

q2: How do teacher students perceive the implementation of test enhanced learning? 

2. Method 

2.1 Participants 

A convenience sample of 88 university students (59 women, 29 men; mean age 23, age range 18-38 years) registered 
2014 on the first semester course Knowledge, Education and Learning (10.0 Credits) participated in the study. The 
quizzing tool was used for part of the course, Developmental Psychology (about 3.0 Credits), and was included as an 
additional, non-scheduled learning assignment. The quizzing proceeded for eight days and was voluntary. A unit 
exam took place 17 days after the introduction of quizzing. 

2.2 Materials and Procedure 
2.2.1 Quizzing Material 

Two of the researchers taught at the course, and also administrated and introduced the quizzing as a learning tool. 
The quizzing material used consisted of 172 questions concerning topics covered in six chapters of the textbook 
“Developmental psychology for educators: an introduction” (Gruber, 2011). The questions, arranged in sections 
corresponding to specific chapters and related lectures, included multiple-choice and short-answer questions. 

For the multiple-choice questions, a statement or problem was presented together with five response alternatives, one 
of which was always “I don’t know”. Immediately after responding the student received feedback in the form of a 
correct answer without the question being shown. For the short-answer questions, the students were asked to define 
key concepts covered in the assigned readings. Immediately after a response was typed in, the student received 
feedback in terms of the complete correct definition. The test was self-paced and the quizzing system was available 
for the students at the course website. 
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2.2.2 Survey Material 

Approximately two weeks after completing the course the aforementioned student sample filled in a survey regarding 
their apprehension of the repeated quizzing and associated test anxiety/stress. The survey instalment was adapted 
from the “Retrieval Practice and Test Anxiety Survey” (Agarwal, D’Antonio, Roediger, McDermott, & McDaniel, 
2014). The questionnaire probed student perceptions of how and why they had used the quizzing tool, how it affected 
their learning and test anxiety, preferences regarding ordinary study habits and study partners, and willingness to use 
quizzing in the future. Additional questions concerned their age, gender, and study hours prior to and during the 
examination week. The question response formats varied (see Appendix in Agarwal et al., 2014, for details), 
including YES/NO, lists with alternatives (e.g., “Please describe what other type of strategies you used”), and 
open-ended formats to allow students to add other alternatives and explain their thoughts and feelings (e.g., “Please 
describe how the quizzing encounters influenced your learning of the topic”). 

The phrasing and order of the questions was identical to those applied by Agarwal et al. (2014), except for two 
modifications. First, we asked our respondents to rank their study strategies, while Agarwal et al. (2014) asked their 
participants merely to list applicable alternatives. This adjustment was done partly to obtain more information on the 
study strategies students usually use when studying on their own (one of the objectives of our study). Second, we 
added the following three questions to the original survey instillment: “Did you use the quizzing tool during the 
progress of the course?” (Yes/No); “Did you use the quizzing tool to improve your learning while quizzing?” 
(Yes/No); and “Did you use the quizzing tool to get information about what you know and what you do not know?” 
(Yes/No). The last question was included because it concerns a metacognitive aspect and prior research suggests that 
students commonly use quizzes to diagnose their learning (Kornell & Son, 2009) and subsequently guide their future 
studies. 

The survey instalment was translated from English to Swedish in two steps. First, the researchers translated the 
survey to Swedish, then a Swedish citizen with English as native language back-translated the survey to English. No 
further changes were needed based on this procedure. 

3. Results and Discussion 

3.1 Time Spent Studying 

On average the full-time students spent less than eight hours per week (Table 1) outside classes studying 
Developmental Psychology, and intensified their effort during the week of the unit exam by 45%, to appr. 11.5 hours 
studying. More than a third of the teacher students reported that they spent more time studying for the focal course 
than for other courses (35%) (Table 1). 

Table 1. Numbers of hours spent by students outside of class 


Study hours spent on a weekly 

basis 

Swedish 

sample (h) 

Study time spent 

relative to other 

classes 

Swedish 

sample 

(%) 

In weeks with no upcoming 

exam 

7.89 

More 

35 

In weeks with upcoming exam 

11.47 

Less 

12 



The same amount 

52 


These results are consistent with official and common media views, and recent research findings (e.g., Bertilsson, 
2014), that teacher students in Sweden invest little effort in their studies. Moreover, their invested efforts seem to 
have been quite stable over time, as Lundgren (2001) found that 80%, 55% and 25% of teacher students, at the 
university we studied spent less than 15, 10 and 20 hours weekly on study outside scheduled activities, scheduled 
teacher-governed activities, and all study-related activities, respectively. 

In addition, the Swedish education system, including teacher education, is characterised as a low stakes system (see 
Nyroos et al., 2015). Thus, the Swedish techer students may have been less motivated to study. 

3.2 Indirect Effects of the Retrieval Practice 

Slightly more than half (52%) of the responding teacher students reported that the retrieval practice, i.e. using the 
quizzing tool, made them less anxious about the unit exam (Table 2). Approximately equal proportions of the 
responding teacher students self-reportedly experienced more, less and similar test anxiety for the unit exam in the 
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focal Developmental Psychology course compared to other courses in the teacher program (Table 2). 

Table 2. Percent of students who self-reported on the effect of quizzes on experienced test anxiety about the unit 
exam; and percent of students who self-reported on experienced test anxiety before the unit exam of the focal course, 
relative to other classes 


Experienced test anxiety 

before unit exam, relative 

to quizzing 

Swedish 

sample 

(%) 

Experienced test anxiety 

before unit exam, relative to 

other classes 

Swedish 

sample 

(%) 

More 

7 

More 

33 

Less 

52 

Less 

29 

About the same 

41 

About the same 

39 


The perceived lessening in exam anxiety by quizzing is consistent with previous findings (e.g., Agarwal et al., 2014; 
Szpunar et al., 2013). However, the students in the Swedish sample did not report any difference in perceived test 
anxiety compared to other courses. Only 24% of the teacher students in our sample included reduced test anxiety 
among the top-four benefits of quizzing (see Table 4 for more details). The present sample was engaged in test 
enhanced learning for a fairly short period of time (cf. Roediger & Karpicke, 2006), and thus, indicate that quizzing 
has considerable scope for further reducing levels of test anxiety among teacher students in Sweden. On the other 
hand, test anxiety appears to be a learnt phenomenon (Bandura, 1982). That tests, in the Swedish goal-oriented 
education system, is one adjacent method in summing and assessing learners’ achievements not used to compare 
students, that no formal final examinations exist, that tests results are not linked to accountability, and that Swedish 
teachers may curry favour with testing among students (e.g., play down stakes see Nusche, Halasz, Looney, Santiago, 
& Shewbridge, 2011), test anxiety could be argued to be a fairly unrecognised educational issue in the present 
context. 

Table 3. Percent of students listing different negative responses to quizzing; and percent who listed negative 
responses as their top four (#1-4) responses 


Listed negative 

response 

Swedish 

sample (%) 

Listed #1-4 negative 

responses 

Swedish 

sample (%) 

1. Made me nervous 

10 

1. Boring 

22 

2. Boring 

9 

2. Made me nervous 

20 

3. Went to quickly 

7 

3. Went to quickly 

15 

4. Liked nothing about it 

2 

4. Liked nothing about it 

14 


It is promising that very few of the responding students (<5%) explicitly stated that they did not like quizzing at all 
(Table 3). The top negative responses were “Made me nervous” (10%) and “It was boring” (9%). Furthermore, only 
one out of five teacher students (22%) listed “Boring” in their top four reasons for not liking quizzing, while almost 
half of the U.S. sample (47%) cited the same response, indicating that further investigation about the possible 
optimal duration of quizzing related to different outcomes is warranted. Or that encouraging the use of quizzing, as 
well as informing about the benefits and potential of quizzing in studying and learning, is required; especially 
considering only 14 % (Table 4) of the Swedish teacher students linked “Means of assessing” to quizzing and 
learning (see discussion below). 

3.3 Direct Effects of the Retrieval Practice 

Almost all the respondents used quizzing (96%), and almost all respondents who used it (97%) reportedly used it to 
enhance their learning and/or to obtain feedback (93%). Indeed, in line with previous findings (e.g., Roediger & 
Karpicke, 2006), the large majority of the responding teacher students (90%), reported that the retrieval practice 
improved their learning. 

The most common reasons stated for why teacher students believed quizzes improved learning were that it assisted 
“Test preparation [for the unit exam]” (32%), “Re vie wing/summarising” (18%), and “Means of assessing” (14%), 
see Table 4. “Test preparation” (63%) was also the most frequently cited reason in the lumped responses, followed by 
“Reviewing/summarising” (57%), and “Providing feedback” (52%) as shown in Table 4. 
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Table 4. Percent of students listing different reasons for learning; and percent who listed reasons as their top four 
(#1-4) reasons 


Listed reason 

Swedish 

sample (%) 

Listed #1-4 reasons 

Swedish 

sample (%) 

1. Test preparation 

32 

1. Test preparation 

63 

2. Review/summarise 

18 

2. Review/summarise 

57 

3. Means of assessing 

14 

3. Provided feedback 

52 

4. Provided feedback 

11 

4. Metacognition 

42 

5. Helped me focus 

6 

5. Helped me focus 

32 

6. Reduced anxiety 

3 

6. Reduced anxiety 

24 

7. Fun 

2 

7. Fun 

20 


Test enhanced learning, per definition, is supposed to enhance learning, implying an effective use of study time and 
therefore not at the cost of time; Agarwal and colleagues (2014) suggested that if students did not study more time 
for classes associated with quizzing, it could be interpreted as retrieval practice was implemented. In the present 
study, 35% of the teacher students reported that they studied more for the class where quizzing was introduced (Table 
1). In keeping with this, several other researchers (e.g., Bjork et al., 2013; Kornell & Son, 2009; Tullis et al., 2013) 
have argued that many learners only recognise the indirect effects of test enhanced learning (i.e., means of assessing, 
or diagnostic tool) but not the direct (mnemonic) effects it has on improving memory retention. Such misconceptions 
about learning through retrieval practices is discernible in Table 4, where more than half (63%, 57%, and 52%), and 
42% judged those second benefits as top four reasons pursuing learning. In addition, only half (55%, 50%) or less 
than half of the present sample (30%, 24%, and 14%) listed using study strategies (Table 5, and see the section below) 
that are related to a cognitive effect, i.e. the mere act of testing strengthens the memory (e.g., Wiklund-Hornqvist et 
al., 2014). Once again we see the need to include teaching on the benefits of test enhanced learning to the students 
introduced to, using, and hopefully in turn implement the method on disciples of their own in order to help them 
understand and maximize said benefits. 

3.4 Study Strategy’ Preferences 

Study habits mentioned by the students (Table 5) included “Reviewing/summarising” (30%), “Repeating facts” 
(25%), “Self-testing” (24%), “Testing by someone” (17%), and “Remembering facts via quizzes” (15%). 

Table 5. Percent of students listing preferred study strategy; and percent who listed strategies as their top four (#1-4) 
strategies 


Listed strategy 

Swedish 

sample (%) 

Listed #1-4 strategies 

Swedish 

sample (%) 

1. Review materials 

30 

1. Review materials 

72 

2. Repeat facts 

25 

2. Repeat facts 

70 

3. Self-test 

24 

3. Tested by someone else 

55 

4. Tested by someone else 

17 

4. Think of quizzes 

50 

5. Think of quizzes 

15 

5. Self-test 

30 

6. Flashcards 

8 

6. Flashcards 

24 

7. Mnemonics 

5 

7. Mnemonics 

14 

8. Other 

2 

8. Other 

9 


With regards to studying alone or with partners “Studying alone” was preferred by the highest proportions of all 
teacher students (49%). Overall, the next most common responses were “Studying with a group” (26%) and “With a 
friend” (21%), as shown in Table 6. 
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Table 6. Percent of students listing with whom to normally study for a test; and percent who listed study partners as 
their top four (#1-4) study partners 


Listed study partner 

Swedish 

sample (%) 

Listed #1-4 study 

partners 

Swedish 

sample (%) 

1. Alone 

49 

1. Alone 

94 

2. Study group 

26 

2. With a friend 

85 

3. With a friend 

21 

3. Study group 

81 

4. Other 

3 

4. Parents or guardian 

39 

5. Parents or guardian 

0 

5. Other 

11 


A study on study strategies by Hartwig and Dunlosky (2012) revealed that more than twice as many (71%) of 
students, enrolled in introductory psychology courses, used self-testing on a regular basis; almost as many (66%) 
reviewed materials, more than twice as many (62%) used flashcards, while 50% of those students studied with 
friends (note that in this study no study strategies were afforded). Moreover, Hartwig and Dunlosky (2012) found a 
positive relationship between spontaneously used self-testing and academic outcome, and a negative relationship 
between collaborative studying and academic outcome. Thus, although the present sample of teacher students 
reported several reasons for quizzing to aid their learning (Table 4), and not really objected to quizzing per se (Table 
3), when it comes down to it, they seem to give in to less useful learning strategies; while “Self-test”, “Tested by 
someone else”, and “Think of quizzes”, still only attract less than one fourth (24%, see Table 5). 

The typical study habits of the present sample (Table 5), and presumably few study hours in general (see Table 1), 
corroborate a cumulative picture of Swedish learners’ sub-optimal learning activities (e.g., Bertilsson, 2014), and 
common (mis)comprehension of the foundation for learning (e.g., Mannikko-Barbutiu et ah, 2011). 

4. Conclusion 

There is a growing body of evidence indicating that test enhanced learning may be a largely untapped resource for 
improving students’ long-term retention performance in educational settings (see McDermott, Arnold, & Nelson, 
2014). Teacher education may serve to offset this limitation and provide future teachers with the skills they need to 
teach effectively. 

The aim of the present study was to examine students’ perception of the implementation of test enhanced learning 
during the progress of a teacher education course. Overall the students perceived quizzing to increase learning and 
decrease test anxiety. However, uncertainties remain whether the primary mnemonic benefits of using retrieval 
practice was immediate accomplished. Based on the students’ misconceptions why quizzing actually enhances 
learning (i.e., not grasping the direct effects), and their general unawareness of study strategies that produces 
powerful benefits for memory, the testing effect, was likely not fully implemented in the present study. 

Indeed, one of the distinct strengths of test enhanced learning, is that it promotes study strategic competencies in 
students that “potentiate subsequent learning” (Arnold & McDermott, 2013, p. 1). Yet, in addition to helping student 
to learn - via improved study effectiveness - the primary benefits of the testing effects is improved retention and 
long-term memory (e.g., Roediger & Karpicke, 2006). Therefore, in terms of these mnemonic benefits of testing, 
several researchers (e.g., Agarwal et al., 2014; Kornell & Bjork, 2007) have postulated that non-compliance with 
memory enhancement implicates that the testing effect is not properly realised. This implementation issue is not 
unique to the present study but aligns with other findings (e.g., Bjork et al., 2013; Tullis et al., 2013). Because test 
enhanced learning has two focal effects: greater retention of the retrieved material (the direct effects), and the 
potential to improve study strategies (the indirect effects), it is for educational purpose imperative to not forget the 
full application. An improved theoretical understanding of the direct mnemonic effects involved in the testing effect 
provides the starting point from which to help students develop their awareness of the practical significance. To make 
teachers (students) increasingly aware of the testing effect, any efforts to translate the extant knowledge base on the 
testing effects into meaningful educational experiences, thus hinges on practices as to knowledge on what the testing 
effect means and what it entails. 

Official reports, media, and research indicate that there are major deficiencies in Swedish schooling (e.g., low 
international rankings in knowledge, attitude, and motivation: OECD, 2014, 2015b). Various critics hold the Swedish 
teacher education programs at least partly responsible for these deficiencies (e.g., Beach et al., 2014), because of 
adherence to traditional, counter-productive practices and neglect of certain study strategies tapping cognition and 
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associated with academic achievements. Teachers tend to take on the instruction methods they have been exposed to 
and have experiences of (see Morehead et al., 2015). Clearly, fostering and raising awareness in teacher students, of 
effective learning methods and how learning is accomplished, could pave the path for their pupils to become lifelong 
learners (see Swoboda, 2014). Thus, in the case of Swedish (teacher) education, instructional theories merit 
considerable more attention in the future. 

Despite the limitations of the present study (notably our use of a small convenience sample, no control group, 
one-item measure), the results indicate interesting findings in line with previous research (e.g., Agarwal et al., 2014). 
The teacher students’ positive responses to repeated quizzing are particularly promising, as test-enhanced learning 
could shape the attitudes of budding teachers (Morehead et al., 2015). They in turn will be responsible for 
implementing new educational strategies - hopefully exploring and take advantage of the relationships among testing, 
cognitive development, emotional engagement, academic achievement and levelled anxiety. 
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